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Introduction 


Two  recent  advances  in  linear  programming  have  been  the  very 
successful  implementation  of  the  Generalized  Upper  Bound  (GUB)  algorithm, 
due  to  Dantzig  and  Van  Sly ke  [3]  and  the  new  methods  for  updating  triangular 
factors  of  the  basis  in  the  Simplex  Method  (Bartels  [1],  Forrest  and 
Tomlin  [4])0  The  purpose  of  this  note  is  to  show  that  despite  the 
special  basis  inverse  manipulation  involved  in  one  step  of  the  GUB 
algorithm  these  two  techniques  can  be  successfully  combined „ 

We  use  the  notation  and  terminology  of  Beale  [2],  denoting  the 
GUB  problem  as  maximize  subject  to: 
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We  denote  the  key  variable  of  each  set  by  x.  .  and  eliminate  them 

3kK 

to  obtain  the  reduced  system 
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and  by  convention  a.  „  ■  0  since  there  is  no  key  for  the  non-GUB 

1Jou 

variables  „ 

The  GUB  algorithm  now  works  with  the  reduced  system  (2)  and 
its  basis  Bo  The  modifications  of  the  product  form  simplex  algorithm 
required  are  detailed  by  Beale  ([2];  ppo  128-130) „ 


Change  of  Basis 


The  only  special  feature  of  the  GUB  algorithm  of  concern  here  is 

the  change  of  basis. ,  and  then  only  in  one  of  the  possible  cases *  This 

occurs  when  the  incoming  variable  x^f  happens  to  eliminate  the  key 

variable  x  of  some  set  s  (where  s  may  or  may  not  equal  r)  which 
•^s8 

has  some  other  non-key  variables  in  the  basis „  In  this  case  a  new  key 
must  be  found  for  set  s  which  we  choose  from  among  the  basic  non-key 
variables,,  Let  the  old  and  new  keys  be  x  ,  x  and  let  x,  be 

V  ''N8  V 

the  ocher  non-key  variables  in  the  set.  The  standard  product  form  method 

•k 

proceeds  by  observing  that  the  old  non-key  columns  £  ■  a. 

•^u8  V  J0“ 

in  the  reduced  basis  B  may  be  effectively  replaced  by  their  new 
* 

representations  a  -a  -  a  through  the  identity 
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That  ia  the  new  representation  of  the  columns  a.  In  B  may  be  obtained 
simply  by  multiplying  B  on  the  right  by  two-element  column  transformations „ 


This  procedure  works  well  for  the  standard  product  form-  However 


if  the  basis  is  maintained  in  triangular  factor  form,  i„e0, 


B  -  LU 


(5) 


where  L  is  lower  and  U  is  upper  triangular,  this  technique  leads 
to  a  loss  of  structure  which  makes  further  iterations  all  but  Impossible „ 


The  Modified  Technique 

An  alternative  to  using  the  elementary  transformations  referred 
to  above  is  to  carry  out  explicit  column  operations  on  B,  though  the 
amount  of  work  required  would  make  complete  reinversion  more  attractive „ 
Using  the  LU  form  of  inverse  however,  we  may  operate  on  U  much 
more  conveniently  In  the  process  of  forming  LU  we  will  have  pivoted 
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where  the  columns  j£  (u  *1,  „ 0 „  ,  v)  of  U  correspond  to  the 
non-key  basic  columns  of  set  s„  Now  if  we  choose  jN  from  among  the 
j  we  see  that  multiplying  the  identity  (4)  on  the  left  by  L-*  we 
obtain 
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Hence  we  choose  to  maintain  triangularity  and  drop  the  new 
key  from  the  basis*.  Similarly  we  must  modify  the  "partially  updated" 
Incoming  column  [5]  if  it  belongs  to  the  same  set  (i0e,,s  r  ■  s)  since 


our 


-1. 


previous  representation  y,  ■  L  (a  -  a  )  involves  the  old  key. 
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The  new  representation  is  from  (4) 
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This  column  is  added  to  the  right  of  U  giving,  for  the  new  basis  Bs 


L-1B  »  H 


where  H  is  upper  Hessenbergt  is  removed;  and  columns  j  (5*  j  ) 

JM  u  N 


'N 

are  replaced  by  -  u .  .  This  matrix  H  may  now  be  reduced  back  to 

Ju 

upper  triangular  form  by  any  of  the  available  methods  (see  [1] , [4] , [5]) . 

Note  that  if  there  is  only  one  non-key  basic  variable  in  the 
set  (i<,e„f  v  ■  1)  no  subtraction  of  columns  is  necessary  and  the  basis 


4 


updating  procedure  becomes  identical  to  that  of  an  ordinary  simplex 

step.  If  there  is  more  than  one  such  column  each  ^u  must  have  u. 

~Ju 


subtracted  from  it„ 


Discussion 

i 

Although  our  choice  of  <  j  preserves  triangularity  we 
cannot  choose  jN  on  the  grounds  of  either  sparsity  or  numerical 
stability  and  furthermore  the  modified  columns  may  now  have  more 
non-zero  entries „  This  makes  repacking  of  the  product  form  inverse  of 
U  necessary.  This  is  not  serious  in  the  Bartels  and  Golub  algorithm 
since  new  non-zero  elements  in  U  are  generated  anyway  (see  [1],  [5])„ 
However  in  the  Forrest  and  Tomlin  method  [4]  the  whole  point  is  to 
avoid  creation  of  new  non-zero  elements  in  existing  packed  columns 
of  U„  Fortunately  cases  where  repacking  would  be  necessary  seem  to 
be  very  rare.  Examination  of  a  number  of  runs  of  GUB  problems  with 
the  UMPIRE  mathematical  programming  system  show  that  basis  changes  of 
this  type  with  v  >  1  occur  in  only  about  two  per  cent  of  the  iterations. 
This  means  that  the  time  lost  in  repacking  will  be  marginal  and  in  fact 
we  may  take  advantage  of  the  opportunity  to  purge  the  backward  trans¬ 
formation  (U)  file  of  deleted  vectors  and  elements  ([4],  p„  272). 
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